Performability Analysis Us ing Semi-Markov Reward Processes
نویسندگان
چکیده
With the increasing complexity of multiprocessor and distributed processing systems, the need to develop efficient and accurate modeling methods is evident. Fault tolerance and degradable performance of such systems has given rise to considerable interest in models for the combined evaluation of performance and reliability [l], [2]. Markov or semi-Markov reward models can be used to evaluate the effectiveness of degradable fault-tolerant systems. Beaudry [l] proposed a simple method for computing the distribution of performability in a Markov reward process. We present two extensions of Beaudry’s approach. First, we generalize the method to a semi-Markov reward process. Second, we remove the restriction requiring the association of zero reward to absorbing states only. We illustrate the use of the approach with three interesting applications. Index Term-Computer performance, computer reliability, graceful degradation, Markov models, performability, reward processes, semi-Markov models.
منابع مشابه
Performability Analysis Using Semi-Markov Reard Processes
With the increasing complexity of multiprocessor and distributed processing systems, the need to develop efficient and accurate modeling methods is evident. Fault tolerance and degradable performance of such systems has given rise to considerable interest in models for the combined evaluation of performance and reliability [l], [2]. Markov or semi-Markov reward models can be used to evaluate th...
متن کاملRecurrence-Relation-Based Reward Model for Performability Evaluation of Embedded Systems
Many embedded systems behave as discrete-time semi-Markov processes (DTSMPs). For those systems, performability measures, especially when specified as an accumulated reward, are often difficult to evaluate analytically. In this article, we informally describe an approach that uses a recurrence-relation-based (RRB) reward model for performability evaluation of systems exhibiting DTSMP behavior. ...
متن کاملA Stochastic Hybrid Systems Framework for Analyzing Markov Reward Models
In this paper, we propose a framework to analyze Markov reward models, which are commonly used in system performability analysis. The framework builds on a set of analytical tools developed for a class of stochastic processes referred to as Stochastic Hybrid Systems (SHS). The state space of an SHS is comprised of: i) a discrete state that describes the possible configurations/modes that a syst...
متن کاملPerformability Optimization using Linear Bounds of Partially Observable Markov Decision Processes
Markov Decision Processes (MDPs) and Partially Observable MDPs (POMDPs) have been proposed as a framework for performability management. However, exact solution of even small POMDPs is very difficult because of their potentially infinite induced state spaces. In this paper, we present new lower bounds on the accumulated reward measure for MDPs and POMDPs. We describe how the bounds can be used ...
متن کامل